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Apparatus, and associated method, for forming a compressed motion vector 
field utilizing predictive motion coding 

Abstract 

Apparatus* and an associated method, motion compensates coding of video 
sequences. Motion compensated prediction is utilized in the 
representation of motion vector fields. Reduced numbers of bits are 
required to represent the motion vector field while maintaining a low 
prediction error, thereby facilitating improved communication ot\ and 
recreation of, video frames forming a video sequence. 
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is ^ 4M* fR »] & JL* m & * j% jjg, ^ ^ # & & 



« s4 W . Is * * *& *fc A *#4l * # — 3&#S3S tfr 48 * 

if it T '* ffi Kt 8) . «H 4fc & £ =&0>J 6$ £t T if- ifaAt & 

15 ^WjM'J**.-*. T«Jl**TJlfjMLWA^.aW. 
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<& i>' 7 £ <& * b # * ^ **> ^ * *i t ^ 4A M 3§- 1^7 J$ ^ 8- # «L 
/Mttf>#~ tft«* INTRA 4frK*JS.iii, &&#4i^JiffiM«iJL#># 
*f-*6ift*ft*t«. .&4ti&£;&#]t , 16* 16 

*f & Ht M **> ftffi»-fettj*i 3fr#S3£ ^ ^ # M * fit 

i« <tf , *t # >£• 6$ b 6^ *<f*.<f*. &.'UL : ®mikM.& >h , ifr T /* 
25 4. (rate-distortion) " i& fctf}ttMi£.%j9> 

t£M . it**** ffi fcjtii J* « A*» 34.S0 
Jt (level of distortion) ffi^ti . 
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^--^-fiL^ * 6i,& a »r w si «j tew**!*?? , -frjL&n-^-srvm 

5 £Ltf4Ull£.£ fiUfaft* —-fit 6^ ^£25 St 6^1 #^0^5:. 

j£S#t^**m& Sib, JM&»>b#. a) ,£.iiL#;5'J##~ 

4at^*^i£^**lfc4t4i»*F#t^«:#t*» b) 

® « . it* & 35 kj ^ *b myr m *fci^# & 
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tbfcW % >J EJift # Jt- , T M <tf # — ^ —41ft.. *» Jr. #r it , 

m -% & *h 4k & 4ji lit . it — A *t 4A # — jft -t -£ % # 

/U «t 6$ _L & jL i£ flfc <K» ife ^ i* *. fli »} i* £. 

^«.^i£«&J»4HS2. & * *T tt AUfe-Jt Jfc $9 4(5 ft f£ iS'J it 2b £ tf| 

4St^- £ 3_#J i£ J* 4£ SI! . 
20 ^JLd&W*4i«.#i^iRJ!|. A.^*!*} (ft #ivMbtfc*%. 

i£ #t tfr »L A & *t lit it % 4 M* — -t- iS. £ * * *t ^> ^ ^ 4|J ft <K? ^ 
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*"&-?-4St 4x8 jS,8x4 /M^^^a^^-ft^lSL. 
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.£ ^ <ft 4Ldt4"fT^ , — Jfe4ftfi*ii.#^»3! *fe at # 1? & *Wfr/fc^# 

n % fri&m ft n #r r»i *a «js # it a . © t * & vim # 

15 *4fr/\JMfclfc<fri£^f*it« 22 24 tf*fr/o*. i&^iiif^ 

M^T/v I„ (x, y) *»<Mr#l R«f (x> y) 4L«I^|L*^i&^^*. 

Ppntifci3i^^->f J.^T^4.^T^tA t^t^^'S^^^^ -f «*J 0 

4$. 
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i£*M*it* 22 tt£&#Ji£ffrJ$&AbH 28. 28 fe 

ft ? *t A— ifr 

5 m**ft*&*i£fel*i£#*Mjf (MC) ffim$L& 36. fl|*|jRjE 36 

Mttit««4^ft 24 38. 

24 #A«^tt4MlWMXttl(ULMll 42. 4**ffa)«,ftl 
AaMf#M*, wa&wai-aut***** 38 A»#J MC «aH«nrM. W 

26 

14 &te*»?Jii- 52, ffaH&JLftJi&JS. 54, i£ 
15 #*M*#i«4*kB. 36. 56 ii*JSl*MH** 26. 4ftX&S*>tt;K*& 

fcJL 36 »5* A4MHit4h t HWHMI 26 ffl ft |»J ^#41^ . 

iE-^if^ 22 *h£jMMMM<|ift;b£1ti'*ft I n (x, y) 
#tftR„ f (x, y)3L.mtfj$L-fctf)3Li%&±( Ax(x, y> , Ay(x. y) ). 

20 & 4ft^H*» 26 t n" - 

Ax (x, y)^Ay(x, y) Mifttk 

25 *t4L#* ( a x (x, y) » a y ( x, y) ) . -&i£.^^Hj&«S*J4fcJt 36 
*, jaL#6$ifc^***#.*«:|Mf-Jfcit««*fc P„ (x, y) . fiaj 

22 28 UtA^tt R„ f ( x, y ) 
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1 

P (x, y) « R (r + 6x(x, y), y + &{x, y)) 
n ref 

10 £ B (x, y ) . 

14 t. ********* I„ (x, y) A4Hfc 
E„ ( x. y) fi*fcfTJfc: 

3 

15 

T„ (x, y) » Z?^- ( * ♦ (■*,>- >■ >• + 2L(x,y)) + B „ (.x.y) 

<iV5>C4 

20 

0„ <*. y) - /„(*.>»> - T„(x, y) 
& MC ffi*i£.jL 36 #A,44:i&4MMfe9flH4* P„ (x, y) 
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J*#£!. #TT« ffl4Mtttife#&*j&*M)Tfl&-~*t*$*» 

10 5 

AxC*. y) ~ Ax,,, (x, y) + A*,,^. y) Ay(*. y) = d>y prJ (jc, >>) + Ay^, (x, y) 

15 6 

A'^ (»j)=Ic./.(Jij) Ay (x,y)~ * ' Zc „ f„(x t y) 

( (x, y) , ay^ <x, y) ) 4MfcJ&fffl«'Ji£ 

i£#*f^*S«.*j£#*| 2 ^tttfatiiJUttft B n (x, y) — 

25 *>ttJI)ilHbft#t4Hfr£* (DCT) — **3t*tafc*fift*%. ii^fta 
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4S-#J 8 XtSH'l ( Lagrangian criterion ) iMv 

I = D + X ■ B 

5 

A*(jc, ^) = Ax^ (x,y) + te^ix, y) 4y(jr,.y) = &y pra ^y) + ty^x.y) 
IS fll*)**^****^^**^^**— *t:*£.^— >^ial£>^ 

A a* E AMM'J . * * *T4**r >it # /L'Mti^Jt , — &ftllfx%&& 

(signaling information) , ««.W*.*-flt^W— 

£. JST /L^ #9 4p.f& tf; **& * ^*>J 44 . 44 # & 

A 0 j 4u*t Jlife # * * -T- *5 * * + 4IL . 

25 

A^..(x,>) = £c,/.(*.y) A y ( x r y ) „ £ c „ + ,/„(*, y ) 

** 1 /f » I 
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J. ms. tf] 4Mfr*£ # & * « * Jfc. 

m 2 jt-fttaJfci&M 7is.&%>%,i9 } & 28. A tti&^tl 28 & 

66 ^L^T-ftS 68. 

& i£ # itf #J ia , *ifef&^*#*i4^-«a'l'W*iajil}-4St^<ft-«.4K. 

i£##4ffc#.#rgJL 66 IMI 0 6$iM*#*t. #*t# 

20 10 

L(c)=D(c>H X B(c) 

D (c) B (c) ^^}ffl^#i£^**tcstt^«.|a^#*fiJ3&*l 
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12 14 fl^— ■ MC filial 
5 ( Ax prJ (x, y) , Ay ptd < x, y) ) ^#.**i£.*i*.*JB&**fc 

(Ax(x, y) , Ay (x, y) ) . 
*M*v|-* 22 ( m 1 ) W-f*-«.^#^ife^«rTh* 22 f i+ 

15 %*%6*|£ S W/LH*} fr£ Ifttfi ( R« f ( x, y ) I n ( x, 

&4sMfc. ^^it Si ft »lflUL D; /fl 4S 1 1 41* , D ( fete P^«Li 

20 £#. (X p , y p ) , p-1, 2...P^^, ^-fjTl«>Jig.^^^-.-f:><7 ( Ax pri (x p , 

y p ) , Ay pf(J (x p , y p ) } #JL*jMfrife#*:**& 9 $-&6M*r# 

4>K 1 1 

® m ^ , n&p yp)- H n/( x p+te pr J.* p .y p )^ n j lr J.*py p ),y p *0f prl ^* p ,y p ) + .>>>» 

25 

<*>\ II A* R„ f (x, y) e^ifc-fa:* 
i&Hffe**H3t*L^*f' ( Ax fefmc (x p > y p ) , Ay„ fuie ( x p , 



PAGE 42/55 1 RCVD AT 1/1312006 4:34:40 AM [Eastern Standard Time] * SVR:USPTO€FXRF-6/24 * DNIS:2738300 ■ CS1D:17039974517 * DURATION (mm-ss):20-50 



To: USPTO Page 43 of 55 



2006-01-13 09:31:57 (GMT) 



17039974517 From: Winston Hsu 



008I4O37. $ & m;J :{? 3521/30]^ 

— - ■■ • 1 * — ■ — . - - - - - — - - — wm±n+*"T^^^^^** w*mm mtmm* h— ♦ * rfvrih^Mti >w<wwiiMw^ t »w»i^^i^> ip^ ■ l i_p i i i ■ _ 

y p ) ) . f-A. + #*«iJULATtf*i44«*»T: 
12 



10 



13 



r 



14 











L Mm 


*3.2 









15 

15 



20 16 







w \ 




fc — * 










c 2 






W p 







~ i?j Iff. 



4 
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K »M l$ 3122/30 tfi 



10 



i£^^*f*>*i— (N + M) x (N + M) WJiXA«*E 



0 
0 



0 



x 



x 



0 0 0 



***** x4L*iii±ih*T^*W*SBf Cholesky HJUMfft 
/X 17 



15 



20 



i« J* * 4 f M. Ri t *# ^ * *t*r/a 40 A* . 0r#*# * — *4fr 



a 7 
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Ax prd (x, y) , Ay pr<J (x, y) , «^«.-ffc_Ld9*^^jS. (II) , KLXL 
>%M&4LtSL ( 18 ) . 

m 4 * ifc <ft 84 , $ f # tfc £ >W* 86 , ^feis:^^ 

30 ^. i£J£tf>£~>Nfc 86 ^ 16 x 16 #-0-. £->Nfc 

5 i£Ti5l*t^«| tt« A Jt'J^jK. itXHmk 86 A 8*8 

1Mb**: 88. |t 86 ttW«^jt.ifii±^.£S»i5fr*»M._t 

4?f8i?\- m ft « m .sMfri* 4: ^ — ^^t^at-ff 

coding) ;^*mi£*r4&>a&. 
19 

Ax(x >>y ) = /34' + 05' >(y-y,') + /?6 i (x-0 
25 -Jt-t Xo'jfp ^Aftf Ji*fc£i4JMN$afej»*, « 0 ,\ ... P 6 l A^T 
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X * £. iit *J ^ ^ » (ft it #4L * -fife /f) JUt 6^ m *') , *t£ & ^ IS-^L 

Jg-^J >fc #48 X ^ ^#>J <M£& 1 tff *p — 01 -f i£ ^ & * J£ <ti -8* 
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ift W 4* 2ft25/30jff 



20 



10 



15 



20 



Ay,,, (*,.k) = /?4* + 05- (y - y 6 ')+ 0 6* {x - 

xo k *> y 0 k jl*MMfc s k t i 4* £4*. « u, k , ... p 6 k 

*jv^ 19 20 A$^*fjft.*: ^IKP-HS: S k ^iS^&^i^x&iiiSi 
J4^h««l £ tfft Sj + 6*, JJL* t « «. Alt S ; *iWife«& & . 

# # 4ft 1f Mr * P5 *M# J» # 4fc . il & f - A 

* #4MMMJ" . >5* « m * R ,3b *fc4t 

4ft cl, c6iMt#IS:S i #,#T#J&##:al a6. *f-f 16*16 

^3^21 



L°3J 

L J «i 



4096 6664 6664 
0 -889 0 
0 0 ~8* 





— * MA 




a 4 


1 — 


r 


c 2 




a 5 




1 

-J 


L 3- 




_*6_ 





4096 6664 6664 
0 -889 0 
0 0 -889 



"4 

c s 

c 



6 J 
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22 



*»92 I2S13 12513 
0 - 3S75 0 
0 0 - 357SJ 

H * . T f'J S< ^ 3> * J* : 

5 4S£ 23 

= O) * «j • (y - y 0 ') + « 3 (* - x„') 

4^24 

WVk&mk & it & 1 P 6, 19 Sj 6$ &#-i£.^ 

20 T*4»itit^^**^-f^^*«>+^iSL*aA (pixel 

intensities ) ¥) ?r £>. . 
Mji*i5t)&#£4%rr.& (MCI) 



"1 

"2 
a- 



"1 



8192 

0 
0 



12513 
-3575 
0 



12513 
0 

- 3575 



r n 

L c 3. 



5 

^ o _ 



15 



1 1 
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ifea##t#A. (MOP) #1 jMtJMT 
i± MCI fcb#^7t . "ST * MCP X* -f= ^ % & & 6<j & ft # 63 . 

5 *-f flf« MCPasb^ 63 ^-TAMl. MCP 

MCP ^ 

tt'ttTa A mcp jm^*. 

^iC, 25 

15 

Z> = — 0.0000152587 890625 
65536 

■k°%. ( Ax (x, y ) i Ay (x. y) ) ^jjt-gt Sj ft &^i*3&*h#<l±#, 
26 

20 

x'=* x + &x{x, y) • D 
y'=.y+Ay(x,y)-0 

R^MxN jMcft^K M"{0, 1,..., 
255}5tlB}iW?$^l. #^&#£#{x\y7^-&&!5){(U,...,M- 1} * 

{0,1 N-l) *«#*l^«*Jfc**h*jMftfc R wf t#« 

25 ft Ate 8f, j|tJB mffc32iC4$-2-afc4M*ft*& ( cubic 

* 

convolution interpolation ) . l£ if , >T#ri£, 
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10 



IS 



Ay (x, y> > fi\ & 65536 ^SLrfr-ioT: 
4>iC 27 



A*<>, >/) m dx • 65536 + 6x, 5x e {0,1,..., 65535 } 
Ax(x.y) =: </y 65536 + Sy.Sy e {0,1,..., 65535 } 

#*dx, dy, &x^5y^£&ML, <^&i^&A###t 

(x + dx + j - 2,M - 1), J = 1,2,3,4 
x\ * sat (y + dy + k - 2 t N - I), k = 1>2,3>4 

* + sat (u, v) A^T^^L^^^fe^a^: 
^^29 



.to/(k, v) 55 - 



0 


u<0 


' U 


0<M<v 




u>v 



it, jfl -f -=.?fc4MR^ 16>M£*t#.*'ULr jle *»T: 
20 4S- iC 29 



25 ^-tx'i, y\A^j\28 t*f#^««fc<ftalt4*. 



4j 
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ft m 1* #29/3031 



<j,k-l,2.S,4 ) *it**»T: 



«sp/(<Sr/256 + 256) 

= 5p/(<5*/256) 
w, - */?/(256 -(A/ 256)) 
i/,, s= 16384 -(w, + r/, 



ISIS 



v t = 5/?/ (<$y / 256 + 256 ) 
v 2 - (<5> / 256 ) 
v 3 a spl (256 - (£> / 256 )) 
v 4 s J6384 - (v, + v 2 + v 3 ) 



10 



15 



5x^5y «*MfcDt. ft spl (s) Ai£^*L3t>tfri^*t 

32 

1 63 M-is 2 • (1 280- 3 . 5) + 1 02^ / 2048 56(0,1,,.., 255) 
~ ((/ • (655364- / 2 - 5 12- /) + 1 02^ /204 
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